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; , , Abstract. Generalizing the notion of a vexillary permutation, we introduce a 

O , 1 filtration of Sac by the number of Schur function terms in the Stanley syminet- 

^^ ' ric function, with the fcth filtration level called the fc-vexillary permutations. 

^^ ' We show that for each k, the fc-vexillary permutations arc characterized by 

f**^ , avoiding a finite set of patterns. A key step is the construction of a Specht 

f-f^ 1 series, in the sense of James and Peel, for the Specht module associated to the 

diagram of a permutation. As a corollary, we prove a conjecture of Liu on dia- 
gram varieties for certain classes of permutation diagrams related to 3- vexillary 
r 1 ^ permutations. We apply similar techniques to characterize multiplicity- free 

U, Stanley symmetric functions, as well as permutations whose diagram is equiv- 

' alent to a forest in the sense of Liu. 



1. Introduction 

In [30], Stanley defined a symmetric function i^u, depending on a permutation w, 
^ I with the property that the coefficient oi xi ■ ■ ■ xg in Fw is the number of reduced 

f^ ■ words of w. Therefore, if Fy, = ^_^ awxsx is written in terms of Schur functions, 

C"*~- [ then 

|RedH|=^a^A/\ (1) 

A 

'^ ■ where f^ is the number of standard Young tableaux of shape A and Red(w) the set 

Z^ ', of reduced words of w. 

Edelman and Greene [li] gave an algorithm which realizes (1) bijectively and 

shows that the a^x are nonnegative. An alternative approach can be given in 

terms of the nil-plactic monoid [16]. 



OO 






H 



Theorem. Given a permutation w, there is a set £Q{w) of semistandard Young 
C^ . tableaux and a bijection 

Red(w) o {{P,Q) : P G £Q{w),Q a standard tableau of shape shape(P)}. 

The tableaux £Q[w) are those semistandard tableaux whose column word — 
obtained by reading up columns starting with the leftmost — is a reduced word 
for w. The (transposed) shapes of these tableaux precisely give the Schur function 
expansion of F^ '■ 

^w / ^ ^shapc(P)* 7 

Pe£g(w) 



where A* is the conjugate of A. Define the permutation statistic EG{w) ^^a^ 
\£Q{w)\, which we call the Edelman- Greene number. 
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Stanley also characterized those w for which Fw is a single Schur function, or 
equivalently for which EG{w) — 1: these are the vexillary permutations, those 
avoiding the pattern 2143. Our main results can be viewed as generalizations of 
this characterization. The first main theorem shows that £Q{w) is well-behaved 
with respect to pattern containment. 

Theorem 1.1. Let v,w be permutations with w containing v as a pattern. There 
is an injection u : £G{v) ^-s- £Q{w) such that if P Cz £Q{v), then shape(P) C 
shape(t(P)). Moreover, if P,P' have the same shape, so do i{P), l{P'). 

Let 5*00 = Un>o '^"- -^^ immediate corollary is that the sets {w G 6*00 : EG{w) < 
k} respect pattern containment, in the sense that if EG{w) < k and w contains v, 
then EG{v) < k. Our second main result is a sort of converse. 

Definition 1.2. Given a positive integer fc, a permutation w e 5'„ is k-vexillary if 
EG{w) < k. 

For example, the 1-vexillary permutations are the vexillary permutations. More 
information about these permutations and their enumeration can be found in the 
Online Encyclopedia of Integer Sequences (OEIS) entry A005802. The number 
of fc-vexillary permutations in Sn for k — 2,3,4 appear in the OEIS as A224318, 
A223034, A223905. 

Like the vexillary permutations, the fc-vexillary permutations can be character- 
ized by permuation patterns. This is our first main theorem. 

Theorem 1.3. For each integer k > 1, there is a finite set Vk of permutations such 
that w is k-vexillary if and only if w avoids all patterns in Vk- 

For the 2- vexillary and 3- vexillary permutations, we have explicitly identified 
the list of patterns characterizing these sets. We use these properties to prove 
a conjecture of Ricky Liu on diagram varieties related to 3- vexillary permutation 
diagrams. We note that permutation diagrams correspond with forests in the sense 
of Liu if and only if the permutation avoids 4 patterns. Furthermore, we can give 
a nice description of Fulton's essential set for 3- vexillary permutations. 

Schur positive expansions of symmetric functions which are multiplicity free 
have been important in many cases related to representation theory and algebraic 
geometry. For example, the Fieri rule for multiplying a Schur function times a 
Schur function with just one row or column is multiplicity free. More generally, 
Stembridge addressed the question of when the product of two Schur functions 
have a multiplicity free expansion ['^]]. Thomas and Yong refined this work further 
in [33]. 

As a corollary of Theorem 1.1, we show that the multiplicity free Stanley sym- 
metric functions are indexed by a set of permutations closed under taking patterns. 
We conjecture that these multiplicity free permutations can be characterized by 
avoiding a finite set of permutations in S'g U ■ • • U S*!!. As with fc-vexillary permu- 
tations, one can define a filtration on permutations by bounding the multiplicities 
in the Stanley symmetric functions. It is shown that each filtration level again re- 
spects pattern containment. These permutations are also related to a new type of 
pattern on the code of a permutation. We also note that 3-vexillary permutations 
are multiplicity free. 
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In Section 2, we recall the connection between Stanley symmetric functions 
and the representation theory of the symmetric group, along with the Lascoux- 
Schiitzenberger recurrence for computing Stanley symmetric functions. We also 
recall the definitions of pattern avoidance and containment. In Section 3, we in- 
troduce the notion of a James- Peel tree for a general diagram following [12], and 
prove a new decomposition theorem for general Specht modules based on Pieri's 
rule. Section 4 specializes these ideas to permutation diagrams, with the Lascoux- 
Schiitzenberger tree as a key tool, and we prove Theorem 1.1. In Section 5, we 
analyze in more detail the relationship between EG{'w) and EG{v) for v a pattern 
in w, and prove Theorem 1.3. Section 6 gives an application of Theorem 1.1 to 
computing the cohomology class of certain subvarieties of Grassmannians related 
to a conjecture of Ricky Liu. In Section 7, the multiplicity free and multiplicity 
bounded permutations are discussed. Section 8 is devoted to open problems. 

2. Background 

2.1. Permutation patterns. We first recall the definitions of pattern avoidance 
and containment for permutations. 

Definition 2.1. Let x — x{l) ■ ■ ■ x{n) be a sequence of distinct integers. The flatten 
map fl is defined by letting fl{x) be the unique v G Sn such that x{i) < x{j) if 
and only if v{i) < v{j). 

Definition 2.2. A permutation w contains a permutation v if there are ii < ■ ■ ■ < 
ik such that fl{'w{ii)---w{ik)) —v. li w does not contain v, then w avoids v. 
Frequently we call the smaller permutation v a pattern which w contains or avoids. 

Example 2.3. The permutation 2513764 contains the patterns 2143 (e.g. as the 
subsequence 2174) and 23154. It avoids 1234. 

2.2. Specht modules. Our proof of Theorem 1.1 goes via the representation the- 
ory of Sm specifically the interpretation of Fm as the Frobenius characteristic of a 
certain generalized Specht module, which we discuss next. We assume the reader is 
familiar with the classical Sn representation theory described beautifully in [29]. 

Definition 2.4. A diagram is a finite subset of N x N. 

We refer to the elements of a diagram as cells. The diagrams of greatest interest 
for us will be permutation diagrams (sometimes called Rothe diagrams, from [28]). 
Given w € Sn, define 

D{w) = {{i, w{j)) ■■ I < i < j < n, w{i) > w{j)}. 

We'll draw D{w) using matrix coordinates; 

O X • • • • 

o 
^(243165) = ° 



Members of a diagram will be represented by o. We'll often augment D{w) by 
adding x at the points (i, w(i)). By definition, no member of the diagram lies below 
or to the right of an x . 
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A filling of a diagram D is a bijection T : D — > {l,...,n}, where n = \D\. 
There is a natural left action of Sn on fillings of D by permuting entries. The row 
group R(T) of a filling T is the subgroup of 5„ consisting of permutations a which 
act on T by permuting entries within their row; the column group C(T) is defined 
analogously. Define the Young syninietrizer of a filling T by 



peR(T)geC(T) 



an element of C[S'„]. 



Definition 2.5. Given a diagram Z? and a choice of filling T, the Specht module 
S^ is the S'n-module C[Sn]yT, where n = \D\. The Schur function sjj of D is the 
Frobenius characteristic of S^ . 

Remark 2.6. This definition generalizes the familiar definitions when D is the 
Ferrers diagram of a partition. For general D, there is no known expression sjj = 
^rp x^ with T running over some nice set of fillings of D. When 13 is a permutation 
diagram, [ ] shows that the set of balanced labellings of D works, but we will not 
need this fact. 

Replacing T with a different filling amounts to conjugating R(r), C(T), and yx, 
so the isomorphism type of S^ is independent of the choice of T. Reordering the 
rows and columns of D also leads to an isomorphic Specht module, so we make the 
following definition. 

Definition 2.7. If a diagram D is obtained from a diagram D' by permuting 
rows and columns, say D and D' are equivalent^ and write D ^ D' . This includes 
inserting or deleting empty rows and columns. 

A partition A — (Ai > • • • > A^ > 1) has an associated diagram 

{{hj)-l<i<t,l<]<\,}, 

its Ferrers diagram^ which we will also denote by A. Over C, the Specht modules 
of Ferrers diagrams form complete sets of irreducible Sn-representations. For more 
on these classical irreducible Specht modules, see [j 1] or [2i)]. In general, it is an 
open problem to find a reasonable combinatorial algorithm for decomposing S^ into 
irreducibles. Reiner and Shimozono do so in [ ] for percent- avoiding diagrams D: 
those with the property that if (ii, ji), («2, J2) G D with zi > 12, ji < J2, then one of 
(11,^2) and (J2, Ji) is in D. This includes the class of skew shapes and permutation 
diagrams. In a different direction, Liu [ ] decomposes S^ when D is a diagram 
corresponding in a certain sense to a forest. 

2.3. Stanley symmetric functions. Every permutation w can be written as a 
product of adjacent transpositions Si = {1,1 + 1). Let £{w) be the minimal length 
of any such product. Let Red(z«) be the collection of reduced words for w. Thus 
if a = (ai, 02, . . . , af(tu)) £ Red(u') then SaiSa2 ' " ' Sa^,^^ — w and this is a minimal 
length expression for w. 

Given a reduced word a G Red(w), let I (a) be the set of integer sequences 
1 < ^1 < • • • < ie{w) such that if Uj < Oj+i, then ij < ij+i- 
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Definition 2.8. The Stanley symmetric function of w is^ 

It is shown in [ ] that F^ is indeed symmetric. For a permutation w, let 
1™ X w = 12 • • • m{w{l) + m){w{2) + m) • • • . The resuhs of [ ] show that F^ = 
hnim-i-oo 'Si™xiD, where ©u is a Schubert polynomial as defined by Lascoux and 
Schiitzenberger in [17]. The same result can also be seen by decomposing a Schubert 
polynomial into key polynomials using the nilplactic monoid ['"]. This implies 
Fu, = -Fimxto for all m > 1. Theorem 31 in [ ,] and Theorem 20 in [ ] then imply 
the following result, which is also implicit in [14]. 

Theorem 2.9. For any permutation w, F^ = sqi^\. 

Stanley symmetric functions can be decomposed into Schur functions using a 
recursion introduced in [ , ]. Given a permutation w, let r be maximal with 
w{r) > w{r + 1). Then let s > r be maximal with w{s) < w{r). Let tij denote the 
transposition (ij), and define 

T{w) = {wtrstrj '■ £{wtrstrj) = i{w) for some j}; 

or, if the set on the right-hand side is empty, set T{w) = T{1 x w). The members 
of T{w) are called transitions of w. The Lascoux-Schiitzenberger tree (L-S tree for 
short) is the finite rooted tree of permutations with root w where the children of a 
vertex v are; 

• None, if v is vexillary (avoids 2143). 

• T(v) otherwise. 

The finiteness of this tree is not immediately obvious [ ], see Remark 5.16 for 
a short proof. More on the Lascoux-Schiitzenberger tree and its relationship to 
Schubert polynomials and Stanley symmetric functions can be found in [,: ]. 

Monk's rule for Schubert polynomials and the identity Fw = lim„i^oo 6i™xm) 
lead to the recurrence 

v£T{w) 

This, together with the finiteness of the Lascoux-Schiitzenberger tree terminating in 
vexillary leaves, and the fact that Fy is a Schur function exactly when v is vexillary, 
imply that 

^w •^D{w) / ^ '^shapc(D) ; 

V 

where v runs over the leaves of the L-S tree, and shape(w) denotes the partition 
whose shape is equivalent to D{v). Here we use the fact that D{v) is equivalent to 
a partition diagram if and only if v is vexillary [21]. 

Note that upon taking coefficients of a;ia:2 • • • xi in the transition recurrence (3), 
one obtains | Red(w)| = X]ueT{«;) I R-ed(w)|. Little [ ^] gives a bijective proof of this 
equality. 

Remark 2.10. The reduced words of 1 x w are exactly those of w with all letters 
shifted up by 1, and it is known that the same is true of the tableaux in £Q{1 x w) 
compared to the tableaux in £Q{w) since the algorithm only depends on the relative 



Stanley's original function G^ is our F^^i. 
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sizes of the letters in the reduced words [ ]• In particular, the multiset of shapes 
are the same and Fu, = Fixw Since the L-S tree is finite, there is some m such 
that in constructing the tree for 1™ x w, we never need to make the replacement 
of f by 1 X z;. Thus we will ignore this possible step in what follows. 

Example 2.11. The Lascoux-Schiitzenberger tree of 321465 is 

321465 



321546 



421356 341256 324156 



3. James-Peel moves and subdiagrams 

Let Z? be a diagram. Given two positive integers a, b, let Ra^bD be the diagram 
which contains a cell {i,j) if and only if one of the following cases holds: 

• i j^ a,b and (i, j) G D. 

• i — b and either (a, j) G D or {b,j) G D. 

• i — a and both {a,j), {b,j) G D. 

That is, Ra^bD is obtained by moving cells in row a to row b if the appropriate 
position is empty. Similarly, we define Cc^dD by moving cells of D in column c to 
column d if possible. For example, 

o • o ■ o o o 

D - R2^iD = 

o o . . . o 

We also define Ra^bT and Cc^dT for a filling T, in the same way. From here 
through the proof of Theorem 3.5, we always view S^ , gRa^bD ^ gC^^dO g^g j^-^q 
specific left ideals in C[S'|£)|] generated by yr, VRa^bT^ VCa^dT for a fixed filling T 
of D following the notation in Section 2. 

We'll call the operators Ra^b and C'c^d James-Peel moves, thanks to this theo- 
rem due to James and Peel. 

Theorem 3.1. [ I ::', Theorem 2.4] Lei (ii, ji), (12, J2) G D be such that {ii, J2), {12, ji) 
D. Let Dr = Rii^i2D and Dq — Cj^^j^D. Then there is a surjective homomor- 
phism 4>: S^ -* S*^" with S^^ C ker </>. 

We prove a generalization of this statement, and for the proof we will need 
more explicit knowledge of the homomorphism (j). Given (ii,ji), (J21J2) as in The- 
orem 3.1, write Tr — Ri^^i^T and Tc — Cj^^j^T. Let Y and Z be sets of coset 
representatives in C{Tii) and R(rc) respectively such that 

C(Tc) = Y{C{Tc) n C(T)) 

R(r;,) = {RiTR) n R{T))Z. 
Then Theorem 3.1 follows from the identities using the Young symmetrizers (2) 
(a) yr ^ TT = yx,. 
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(b) Yl sgn(7r)7r • yr = VTc 

tt£Y 

(c) yTcY'^ = 0. 

Thus we can take cj) in Theorem 3.1 to be right muhiphcation by X^ttsz """• 

Remark 3.2. Only (c) above depends on the existence of a pair of cells (Ji, ji), {i2,J2) 
as in Theorem 3.1. For arbitrary a,b,c,d we still get a surjection S^ -^ gRa^bO 
from (a), and a containment S'^"^'^^ C S^ from (b). Over C, we also get an 
inclusion S^-^"^ ^ S^. 

Lemma 3.3. Suppose Ra^bCc^dD = Cc^dRa^bD. Let 

he the surjections constructed above. Then 

Proof. Fix a filling T oi D and take sets of coset representatives Z, Z' with 
R(T) - (R(i?a^fcr) n R(T))Z 

liiCc^dT) = (R(i?a^6Cc^dr) n R(Cc^rfr))z', 

so that (f>, (j)' are right multiplication by X^ttgz "^ ^^^ X^u-ez' "" respectively. 
Applying a move Cc-^d to a filling does not affect its row group, so 

R(T) = HiC^dT) - (R(i?a^6C,^rfr) n R(r))z' 

= (R(Ce^di?a^fcr)nR(r))z' 
= (R(i?a^6r)nR(r))z'. 

Thus we can take Z' = Z. D 

Definition 3.4. A subset D' of a diagram 13 is a subdiagram if it is the intersection 
of some rows and columns with D. That is, there are sets C/, F C N such that 
D' ^ {U xV)nD. 

Given two diagrams Di,D2 with Di C [r] x [c], let 

Di-D2^DiVJ {{i + r,j + c): {i,j) £ D2}. 

In this language, Theorem 3.1 applies when we have (1) ■ (1) as a subdiagram 
in D. Our generalization of the James-Peel Lemma applies to a subdiagram of the 
form (p— l,p— 2,...,1)-(1). To simplify indexing, we will assume without loss of 
generality that our subdiagram occurs in rows 1, . . . ,p and columns 1, . . . ,p. Write 
5p for the staircase shape (p — l,p — 2, . . . , 1). 

Theorem 3.5. Suppose D contains Sp ■ (1) as a subdiagram in rows 1, . . . ,p and 
columns 1, . . . ,p. There is a filtration 

= A/o C A/i C • • • C Mp = S^ 

of S^ by S\i:i\-submodules such that for each I < j < p, there is a surjection 
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Proof. Let Fj — Cp^jD and Gj — Rp^p-j+iCp^jD. Set 



Mj = J2s^' C5^. 



Consider, for each j, the two surjections 



given by Theorem 3.1. We have Rp^p^j^iCp^jD — Cp^jRp^p-j+iD. Indeed, 
this commutation property depends only on the subdiagram of D in rows p — j + l,p 
and columns j, p. By hypothesis this subdiagram is 



and either order of James- Peel moves results in the subdiagram 



Therefore, Lemma 3.3 says that 6j = (fijlgFj . 

li 1 < i < j, then {i,p - j + 1), {p,p) G D and {i,p), {p,p - j + I) ^ D, so 
Theorem 3.1 implies that 5^' C kert/)^, hence Mj_i C kei (j)j. Thus, S^^ nMj_i C 
S^^ n ker^j = keiOj, so 6j descends to a surjection 

Since there is a canonical isomorphism 

given by m + Mj^i n> m + S^^ D Afj_i where to e 5^^ , we are done. 

D 

Remark 3.6. Theorem 3.1 and hence Theorem 3.5 are actually valid over any 
field, and lead to the existence of Specht series for certain Specht modules. A 
Specht series for an S'„-module Af is a filtration = Mq C Mi C • • • C Mn = M 
where each quotient Mi^i/Mi is isomorphic to a (classical) Specht module S'^. Over 
C these are just composition series, but in general they are coarser, since Specht 
modules are indecomposable but not necessarily irreducible in finite characteristic. 

We won't need this level of generality, so from now on we will work over C and 
freely split exact sequences. In particular. 

Corollary 3.7. IJ D contains 5p- {!) as a subdiagram in rows 1, . . . ,p and columns 
1, . . . ,p, then we have the inclusion 

p 

as S\£)\-modules over C. 

Observe that Cj^jD = Rj^jD — D for all j and D, so for j = 1 and j = p 
above only one move changes the diagram. 
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Example 3.8. Take 



D = L>(4261735) = 



o o o 

o 

o • o 



where we have omitted the last empty rows and columns. The subdiagram in rows 
1, 2, 5 and columns 1, 2, 5 is (2, 1) • (1). The following diagrams appear in (4): 



o o o 
o 
i?5_i.lZ3 = o • o 



-^5^2 (^5^2 



D 



o o o 
o o o 
o o o 



C5^iD 



o o o 

o 

o • o 



Corollary 3.7 now says S'(3'3'3)eS'«5-i^eS'Cs^i^ ^ S^M. Applying Theorem 3.1 
to the cells (2, 1), (5,3) in R5^iD gives S^^'^^"^^ © 5'(4,3,i,i) ^ S"^^^'^. Using the 
cells (1,2), (3, 5) in Cs^iZ?, Theorem 3.1 gives 5'(4,2,2,i) ^^ 5.(3,3,2,1) ^ 5-05^1!) jn 
fact, all these inclusions are isomorphisms 

gDiw) ^ 5(3,3,3) ^ 5(4,3,2) ^ 5(4,3,1,1) ^ 5(4,2,2,1) ^ 5(3,3,2,1)^ 

as one can check using the Lascoux-Schiitzenberger tree, or by computing the 
Edclman- Greene tableaux of 4261735: 



1 


2 


3 


2 


4 


5 


3 


5 


6 



1 


2 


3 


2 


4 


5 


3 


6 




5 







1 


2 


3 5 


2 


4 




3 


6 




5 







1 


2 


3 


5 










1 


2 


3 


5 


2 


4 


6 




2 


4 


6 




3 

5 










3 


5 













This example also provides a case where Theorem 3.5 is more powerful than 
Theorem 3.1. For reasons which will become clear in Section 4, we would like to 
apply James-Peel moves which apply to the cell (5,5), as the first stage of moves 
above do. There are 3 possible cells one could pair (5,5) with in Theorem 3.1: 
(1,1), (1,2), and (2,1). However, one finds that in each case that the inclusion 
gCa^dD 5_R„^i,D ^^ 5D jg j^q|- g^j^ isomorphism, so S^ cannot be completely 

decomposed using such moves. 

Note that when Corollary 3.7 is applied to the diagram Sp-{1) itself, the resulting 
partitions are exactly those arising from applying Pieri's rule to expand s^^s^i) in 
terms of Schur functions. Indeed, it follows readily from the group algebra defini- 



tions that 5^1 -"^ ~ Ind 



Di\ + \D2\ 



S^^ ® S^'^, and hence that SD1D2 = sdiSd^ 



We can therefore view Corollary 3.7 as applying Pieri's rule to a subdiagram of D. 
See the discussion surrounding Example 3.17 for an expansion on this idea. 

Definition 3.9. Given a diagram D contained in [m] x [n], define 

£)max _ (i^j^^^ . . . R2^i){Rm^2 ' ' • ^3^2) ' ' • {Rm^m-l)D 
-D""" = (C„_>.i • • • C2^l)(C„^2 • • • C'3->2) • • • {Cn^n-l)D- 

These diagrams are both equivalent to partitions — an identification we will freely 
make— and satisfy s^"''''' , S°""" ^ 5^ by Remark 3.2. To be precise, Z?'"'" is the 
partition gotten by sorting the row lengths of D, and D"^^^ is the conjugate of the 
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partition gotten by sorting the column lengths. This second description implies the 
following lemma. 



max 

in in 



Lemma 3.10. If I is any sequence of James-Peel row moves Ra^b, then D 
(ID)™^". Likewise, if 3 is a sequence of column moves Cc^d, then £)""" = [JD) 

The partitions £)™'" and D'^^^ play a special role in the structure of S^ . In the 
case D = D{w), the next lemma is Theorem 4.1 from ['ii]. 

Lemma 3.11. Let D be any diagram. If S^ '-^ S^ , then D""" < A < D'"'^'' in 
dominance. Also, S^ and S^ appear in S^ with multiplicity one. 

Proof. We will prove the part of the statement referring to D""", with the proof 
for D"^'^^ being analogous. Induct on £{D™™), the number of non-empty rows of D. 
The lemma is obvious when I? is a single row. Let iJ be a row of D with minimal 
length, and set E = D\II. Then D is the image oi E- H under James-Peel moves — 
push H to its original row, then each cell individually to its original column — so 

Suppose S*^ ^-^ S^ ^-j- S^'^ . Since se-h — seSr, Pieri's rule says /i is obtained 
from some A with S''^ ^-> S^ by adding \II\ cells to it, no two in the same column. 
By construction, £)™'" is obtained by appending a row of length \II\ to i<^™™. The 
induction hypothesis gives £'™'" < A. To show £)""" < ^^ let a, /3 be the partitions 
equivalent to L»""" and ^'°"\ Observe that for all 1 < m < ^(^™'"), 

m m m m 

^a,,=^/3, <^A, <^/i., (5) 

i—1 i—1 i— 1 i— 1 

while if m = ^(i;'"'") + 1 == £(D™'"), both sides of (5) are equal to \D\, since 

i{fi) <e{x) + i <^(^™")-f 1. 

By induction, S^ appears with multiplicity one in S^. Since Pieri's rule is 
multiplicity free, S^ appears with multiplicity one in S^'^ , hence with multi- 
plicity at most one in S^ . Furthermore, S^ does actually appear in S^ , because 
jjmm jg ^j^g image of D under James-Peel moves, and so it appears with multiplicity 
one. D 

James-Peel moves and Corollary 3.7 present one possible way to decompose a 
Specht module into irreducibles. In general it is not known if an arbitrary Specht 
module can be decomposed by finding some appropriate tree of James-Peel moves, 
as the inclusion in Corollary 3.7 may not be an isomorphism. The way we prove 
Theorem 1.1 is to find such a decomposition for the case of D{w). The usefulness of 
James-Peel moves for us comes from the fact that they are well-behaved with respect 
to subdiagram inclusion, and pattern inclusion for permutations corresponds to 
subdiagram inclusion on the level of permutation diagrams. 

To be more precise about this, we make the following definition. 

Definition 3.12. A James-Peel tree for a diagram Z? is a rooted tree T with 
vertices labeled by diagrams and edges labeled by sequences of James-Peel moves, 
satisfying the following conditions: 

• The root of T is D. 

• If _B is a child of A with a sequence JP of James-Peel moves labeling the 
edge A—B, then B = 3P(A). 
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• If A has more than one child, these children arise as a result of applying 
Corollary 3.7 to A. That is, A contains Sp ■ (1) as a subdiagram in rows 
ii < ■ ■ ■ < ip and columns ji < ■ ■ ■ < jp, and each edge leading down from 
A is labeled Ri^^t _t+iC'jp^jfc for some distinct values 1 < k < p (perhaps 
not all such k appear). 

Note that the vertex labels are completely determined by the root and the edge 
labels. When a vertex is labeled by a permutation diagram -D(w), sometimes we 
will refer to it simply as w. See Examples 3.17 and 3.20 later in this section for 
examples of James-Peel trees. 

Corollary 3.7 and Remark 3.2 immediately imply the following lemma. 

Lemma 3.13. If D has a James-Peel tree T with leaves Ai, . . . , Am, then ^,- S' • '— >■ 
S^ as S^D^-modules over C 

Definition 3.14. A James-Peel tree T for D is complete if its leaves ^i, . . . , A^, 
are equivalent to Ferrers diagrams of partitions and S^ ~ 0^ S^^ . 

In [12], an algorithm is given which constructs a complete James- Peel tree when 
D is a skew shape. More generally, Reiner and Shimozono [25] construct a com- 
plete James- Peel tree for any column- convex diagram: a diagram D for which 
(a,x),(6, x) e D with a < b implies {i,x) G -D for all a < i < b. In the next 
section we construct a complete James-Peel tree for the diagram of a permutation, 
so it's worth noting that neither of these classes of diagrams contains the other. 
For example, 15(37154826) is not equivalent to any column-convex or row-convex 
diagram, while the column-convex diagram 

o o • • 
o • o • 
o • • o 

is not equivalent to the diagram of any permutation. The James-Peel trees con- 
structed in [-] and [- ] are binary trees based on moves from Theorem 3.1. By 
Corollary 3.7, the James-Peel trees constructed here do not need to be binary, a 
vertex can have an arbitrary number of children. 

Remark 3.15. Theorem 3.5 shows that a complete James-Peel tree for D yields 
a Specht series for S^ over any field. In particular. Theorem 4.2 below shows that 
^n(iu) a^i.^ya,ys has a Specht series. 

Definition 3.16. Given a James-Peel tree T' for a subdiagram D' of D, the induced 
James-Peel tree T for D is defined as follows. Start with T an unlabeled tree 
isomorphic to T', with : 7"' — ?• T an isomorphism. Give each edge 4>{Ai) — ^(^2) 
of T the same label as the edge Ai — A2 of 7"'. Label the root 4>{D') of T with D, 
and label the rest of the vertices according to the James-Peel moves labeling the 
edges in T. 

Observe that the first two conditions of Definition 3.12 clearly hold for T as 
constructed. The subdiagram of D' needed in the third condition for T' and D' 
works just as well for 7" and D, when viewed as a subdiagram of D. Thus, 7" is a 
James-Peel tree for D. 

The notion of an induced James-Peel tree provides a convenient way to discuss 
a generalization of Theorem 3.5 from the case of a subdiagram 5p ■ (1) to that of 
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any subdiagram A • (fc) with A a partition. Recall the classical Fieri rule: 

/J 
where /i runs over all partitions gotten by adding k cells to A, no two in the same 
column. That is, let hstripS;.(A) be the set of length i{X) + 1 compositions a oi k 
such that ai < Aj - Aj_i for i > 1. Then s^s^k) = Z]aehstiipSfc(A) *a+q, where X + a 
is entrywise addition. 

The moves in Theorem 3.5 can be thought of as realizing Pieri's rule on Sp ■ (1) 
in terms of James-Peel moves. Suppose we have a James-Peel tree 7" for A • (fc) 
whose leaves are the partitions A -I- a for a G hstripSj.(A). If D contains A • (A;) as a 
subdiagram, we can take the James- Peel tree for D induced by T, which amounts to 
realizing Pieri's rule on the subdiagram A- (k) using James- Peel moves, generalizing 
Theorem 3.5. 

In fact we only need the case X — Sp, k = 1, so rather than state and prove a 
precise theorem, we will be content with giving an example of such a tree. 

Example 3.17. Take A — (3, 1, 1), k — 2. In each non-leaf vertex, we have shaded 
the cells to which Theorem 3.5 is being applied. 

• • o • • 

• • • • • 

o • • • • 



Ri- 



-R4-^2C'5->2 
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The main example of induced James- Peel trees for us will come from permutation 
patterns. The connection is that if w contains a pattern u, then D{v) is (up to 
reindexing) a subdiagram oi D(w). Specifically, if the pattern v appears in positions 
ii, . . . , ifc of u", then D(v) is the subdiagram of D{w) induced by the rows zi, . . . , i^ 
and columns w{ii), . . . , w(ik)- 

Let M{D) denote the multiset of partitions of n = \D\ such that S^ ~ ®xeM(D) '^^■ 
Given partitions A, /j,, let A + /i be the partition (Ai -I- ^i , A2 -I- /i2, • ■ •); padding A or 
H with O's as necessary. Let A U /z be the partition whose parts are the (multiset) 
union of the parts of A and those of /x. 

Lemma 3.18. Suppose Di,D2 are subdiagrams of D, each with a complete James- 
Peel tree, and such that Di ^ (U x V) n D and D2 = (U'' x V) (1 D. Let Fi = 
(U'^ X V) (1 D and F2 = {U x V^) D D. Then there is a well-defined injection 
i : M{Di) X M{D2) -^ M{D) given by 

t(A,^) = (AUFr") + (F2--U/.). 
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Proof. Without loss of generality we can assume U = {1,2, . . . ,i} and V ~ {1,2, . . . ,j} 
by permuting rows and columns of D if necessary. Let 7i , 72 be complete James- 
Peel trees for Di,D2. Then, we can further assume that the leaves of 7i, 72 are all 
partition diagrams by doing extra James-Peel moves to sort the rows and columns. 
Let T be the James- Peel tree for D induced from 7i, with : 7i — )► T an 
isomorphism as in Definition 3.16. Since D contains Di — (j)^^(D) as a subdiagram, 
each vertex A oi T contains (/)~^(A) as a subdiagram. In particular, each leaf B of 
T has the block form 



B = 



A 


Fi 


Fi 


D2 



(6) 



d, and F^ 



where A is the shape of (p^^{B), F[ is the image of Fi under moves C, 
the image of F^ under moves Ra->b- 

Using the block form (6), we next add a single child to each leaf B of T- By 
Lemma 3.10, (i^i')'°'" = (i^i)""" and (i^^)'"^'<^ = (i^2)™''''. Thus, there is a sequence 
1b of upward row moves involving only rows in U, and a sequence 3b of leftward 
column moves involving only columns in V, such that 3b{F{) = F™'" and 15(^2) = 
^max^ Since the upper-left block is a partition diagram, it is unaffected by the 
James-Peel moves Ib and 3b- Since no cell of D2 lies in a row in [/ or a column in 
V, 3b and Ib do not change D2 either. Thus, we can define 



B = Ib3b{B) = 



To each leaf B of T, attach the child B via an edge labeled Ib3b- Note, the result 
is still a James-Peel tree for D. We will abuse notation and again call this tree T. 
We modify 7" one more time by augmenting each leaf with an induced tree for 
D2. Specifically, to each leaf B of T, attach the James-Peel tree for B induced by 
72- As above, each leaf C of the new tree descending from B now has block form 



A 


TTTnax 


TTTiiin 


D2 



c 



A 


I?" 

J"2 


Fi' 


^^ 



(7) 



where A,/x are a pair of shapes in M{Di) x Af(Z?2), ^i" is the result of applying 
row moves to F™™ and F2 is the result of applying column moves to i^™^'^. Notice 
that the upper-right and lower- left block of B and C are equivalent, since both are 
equivalent to partitions. The upper-left block of B and C are exactly the same 
since the induced tree for B does not touch the first i rows and j columns. Again, 
we abuse notation by calling this tree T- 

Finally, we modify T once again so the leaves all have block form with 4 partition 
shapes. Assume C is a descendant of B with block diagonal shapes A, /z as in (7) 
above. Let Ic be the sequence of upward James-Peel row moves needed to sort the 
rows of Fi into the partition shape F™'", and let 3c be the sequence of leftward 
column moves needed to sort the columns of Fj' into the partition shape F™^^. 
Note, such moves will not change the shapes A and /i when applied to C since they 
are partitions. Thus, one can define 



C := lc3c{C) = 



A 


TTTnax 


TTTtim 


M 



(8) 



with all four subdiagrams equal to honest left- and top-justified Ferrers diagrams. 
For each leaf C of T, attach C = IcJc(C) as a child. 
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Observe that the resulting tree T is a James-Peel tree for D, and the leaves are 
in bijection with the multiset M{Di) x M(Z?2)- One can also see that if a leaf C 
of T has diagonal shapes A, ^ then 

and the shape of C™^^^ only depends on A, /i, Fi, i^2 and not on B or C. Thus, we 
define t(A, /i) to be the partition of shape C™^^ which is in M{D) by Lemma 3.11 
and Lemma 3.13. This gives a well-defined injection of multisets l : M{Di) x 
M{D2) -^ M{D) as intended. D 

For the most part we will only need a simpler version of this lemma. 

Corollary 3.19. Suppose D has a subdiagram D' with a complete James-Peel tree. 
There is an injection i : M{D') ^-)- M{D) such that A C t(A). Moreover, i(A) 
depends only on X: if X appears k times in M{D'), then t(A) appears at least k 
times in M{D). 

In particular, taking D — D{w) and D' = D{v) for v a pattern in w, Corol- 
lary 3.19 together with the equalities 

SD(w) — Fw — 2_^ Sshapo(P)* 

will immediately imply Theorem 1.1 once we show that D(w) always has a complete 
James-Peel tree. 

Example 3.20. Take the diagram D — £'(316524). Rows 5,6 and column 6 are 
empty, so we won't draw them in the following picture 



D = 



Let Di be the subdiagram on rows 1,2,3 and columns 1,2,3,4 which corresponds to 
the pattern 31524 = fl(31624), so Di ~ 15(31524). 
A complete James-Peel tree 7i for Di is 

Ai A2 

where Ai ~ (3, 1), A2 ~ (2, 2). The James-Peel tree 7i for Di induces the following 
James-Peel tree T for D 

D 

B31 B22 

where B31 = R^^iD and -822 = C^^iD with 
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B31 — 



B22 — 



Following the proof of Lemma 3.18, we next apply leftward column moves to the 
lower left subdiagrams F{ to get (F{)™'", and upward row moves to the upper right 
subdiagrams {F2) to get (Fj)™'*'^: 



B31 = C4^ii?3i — 



B22 — Ri^lB22 — 



At this point we would apply James-Peel moves to the lower right subdiagram, 
but it is empty so there's nothing to do. Finally, we apply leftward column moves 
and rightward row moves to make all four subdiagrams into Ferrers diagrams (up 
to trailing empty rows and columns): 



C'31,0 — i?3-s.2C'4_>3C2^li?3l — 



000 
o 



^"22,0 — ^3^2^22 — 





























Now, taking unions before additions as the order of operations 

(^31,0)'"'^'^ = (3, 1) U (2) + (1) U - (3, 2, 1) + (1) = (4, 2, 1), 

{C223r^'' = (2, 2) U (2) + (1) U - (2, 2, 2) + (1) = (3, 2, 2). 

For the injection t : M{Di) ^-> M{D) we therefore take t(3, 1) = (4,2,1) and 
i(2,2) = (3,2,2). Indeed, sdi = -F31524 = S32/1 = S31 + S22, while sd = F316524 = 

S322 + S33I + S421- 



4. Transitions as James-Peel moves 

Recall the following notation from Section 2. Given a permutation w, take r 
maximal with w{r) > w{r + 1), then s > r maximal with w{s) < w{r). The set of 
transitions of w is 



T{w) — {wtrstrj '■ £{wtrstrj) = ^w)} , 



(9) 



or else T(l x w) if the set on the right is empty. Note that wtrstrj G T{w) if and 
only if u'(j) < w{s) and there is no j < j' < r with w{j) < w{j') < w{s). 

Upon taking diagrams of permutations, each transition corresponds to a sequence 
of James-Peel moves. 



Lemma 4.1. Given a permutation w, let r,s be as above and take w' 
T{w). Then 

D{w') = Rr^jCro[s)^w{j)D{w) = Cru{s)^w{j)Rr^jD{w). 



UJ hf gVip '} \Z. 
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Proof. We will show that the change in passing from D{w) to D{w') is as follows: 



w{j) 


w{s) w{r) 


w{i) w{s) 


w{r 


i X 




o ^g 






1 


^ 1 





where we move the cells in each shaded region of D(w) into the corresponding 
(formerly cell-free) shaded region oi D{w'), and also move the cell (r, w{s)), denoted 
by o above, to ij,w{j)). Here only the region [j,r] x [w{j),w{s)] together with row 
s and column w(r) have been drawn. We will show the rest of the diagram remains 

unchanged. We use • • • and : to denote a sequence of empty cells of arbitrary length. 

Consider row- by- row the effect on diagrams of passing from w to w' . It is clear 
that rows k < j of D(w') match those of D{w). Rows k > s also match: indeed, 
they are all empty. 

In row J, by passing from D{w) to D{w') we could only gain cells. Specifically, 
a cell is gained in column w{k) if and only if the following equivalent conditions 
hold: 

• w(j) < w(fc) < w(s) and k > j, or w{k) =■ w(j) 

• w{j) < w{k) < w{s) and A; > r, or w{k) = w{j) 

• (r, w(fc)) e D{w) and w{j) < w{k), or w{k) = w{j). 

On the other hand, in row r, we could only lose cells. A cell is lost in column 
w{k) if and only if following equivalent conditions hold: 

• w(j) < w{k) < w{r) and k > r 

• w{j) < w{k) < w{s) and fc > r, or w{k) — w{s) 

• {r,w{k)) G D{w) and w{j) < w{k), or w{k) = w{s). 

Thus, the effect of passing from w to w' on rows j and r is to move all cells in row 
r between columns w{j) and w{s) up to row j, and to move {r,w{s)) to {j,w{j)). 
Now say j < k < r. The only column in which a cell could be gained in row k is 
column w{j), which happens if and only if the following equivalent conditions hold: 

• w(fc) > w{j) 

• w{k) > w{s) 

• {k,w{s)) e D{w). 

Conversely, if there is a cell in row k and column w{s) of D{w), it is lost in D{w'). 
So at least within the region [j,r] x [w(j),w(s)], one does obtain D{w') from 
D(w) by performing the indicated James-Peel moves. To show that in fact D{w') — 
Rr^jCw(^s)^w{j)D{w), we must show that these James-Peel moves do not move any 
cells outside of [j,r] x [w{j),w{s)]. That is: 

(i) If {k,w{s)) <E D{w) for k < j or k > r, then {k,w{j)) £ D{w). 
(ii) If (r, w(fc)) e D(w) for w{k) < w{j) or w{k) > w{s), then (j, w(fc)) G D{w). 

For (i), rows k > r are empty, so assume k < j and {k,w{s)) G D{w). Then 
w{k) > w{s) > w{j) and k < j give {k,w{j)) G D{w). For (ii), {r,w{s)) is 
the rightmost cell in row r by the choice of r, s, so assume w{k) < w{j) and 
{r,w{k)) G D{w). Then {j,w{k)) G D{w), because j <r <k and w{k) < w{j). D 
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Theorem 4.2. For a permutation w , the diagram D[w) has a complete James-Peel 
tree. 

Proof. If w is vexillary, the tree with one vertex D{w) and no edges is a complete 
James-Peel tree for D{w). Otherwise, let w^, . . . , w^ be the transitions of w, say v"^ — 
wtrstrji where s > r > ji > ■ ■ ■ > jp. Then w{ji) < ■ ■ ■ < w{jp) < w{s) < w{r), 
so &iw{jp)---wiji)w{r)w{s)) =p---l(p + 2)(p + l), and L>(p- • • l(p + 2)(p + 1)) 
is exactly {p ~ 1,...,1) ■ (1) after removing an empty row and column. Thus, 
D{w) contains (p — 1, . . . , 1) • 1 as a subdiagram in rows jp, ■ . ■ ,J2,T and columns 
w(ji),...,wOp_i),-u;(s). 
Let 

{Rr^j,C^(s)^^i^j^)D{w) liKi <p 
Cw{s)~^w{jt)D{w) ifi = l 

Rr^jj,D{w) iii=p 

The diagrams Di are exactly those produced by Corollary 3.7, and ®f^]^ 5*^* ^^ 

qD(w) 

Let T be the James-Peel tree with root D{w) and children Di, where D{w) 
is connected to Di by an edge labeled with the appropriate James-Peel move(s). 
Next, connect Di to a child Ei = Rr^j^Di by an edge labeled Rr^j^, and 
Dp to a child Ep ~ C'^(s)^tu(j )Dp by an edge labeled C^(s)^u,(j )■ The leaves 
Ei,D2, . . . ,Dp_i,Ep of T are now exactly D{v^), . . . ,D{v^) by Lemma 4.1. At- 
tach to each D{v^) the tree inductively produced for v^ by transitions and so on 
until every leaf is the diagram of a vexillary permutation. 

The tree T is still a James-Peel tree for D{w). By construction, its leaves are 
the diagrams of the leaves of the Lascoux-Schiitzenberger tree of w. The equation 
Sd{w) = ^v ■Sshape(t)) from Scctiou 2, with v running over the leaves of the L-S tree, 
implies that T is complete. D 

Let JP{w) be the James-Peel tree for D{w) constructed in Theorem 4.2. Corol- 
lary 3.19 and Theorem 4.2 now yield our first main result. 

Theorem 1.1. Let v^w be permutations with w containing v as a, pattern. There 
is an injection i : £Q{v) ^^ £Q{w) such that if P € £G{v), then shape(P) C 
shape(t(P)). Moreover, if P, P' have the same shape, so do t(P), l{P'). 

Corollary 4.3. // a permutation w is k-vexillary and v is a pattern in w, then v 
is k-vexillary. 

Corollary 4.4. If v is a pattern in w and F^ is multiplicity-free, so is Fy. More 
generally, if (Pm, sx) < k for all X then {Fy, s^) < fc for all fj,. 

Remark 4.5. Theorem 1.1 shows the existence of an injection £Q{v) ^-> £Q{w) 
which respects inclusion of shapes for v a pattern contained in w, but an explicit 
map on tableaux is lacking. The Edelman- Greene correspondence shows that this 
is equivalent to an injection Red(w) ^->- Red(w) which is an inclusion on the shapes 
of Edelman-Greene insertion tableaux. Tenner's [32] characterization of vexillary 
permutations yields an explicit injection in the case where v is vexillary. 

Remark 4.6. We note that Crites, Panova and Warrington have studied the con- 
nection between the shape of a permutation under the RSK correspondence and 
pattern containment [5]. The injection given in Theorem 1.1 on shapes is quite 
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different since the Edelman- Greene tableaux of a permutation are based on the 
reduced words instead of the one-hne notation. At this time, we don't know of a 
connection between their work and our injection. 

So far we have only used Corollary 3.19, but the full strength of Lemma 3.18 
yields another interesting result. 

Theorem 4.7. Let w ^ Sn be a permutation and / C [n\. If ui is the subsequence 
of w in positions I , and U2 the subsequence in positions [n] \ I , then 

EG{w) > EG{&{ui)) ■ EG{&{u2)). 

5. fc-VEXILLARY PERMUTATIONS 

In this section we show that the property of fc-vexillarity is characterized by 
avoiding a finite set of patterns for any k. The key step is to remove some inessential 
moves from the James- Peel tree for D(w)^ namely those which only permute rows 
or columns. 

If D is an arbitrary diagram, and a, r are permutations, let (cr, t)D be the 
diagram {(c(i), t(j)) : {i,j) G D}. Given a James-Peel tree T for D, let {a,T)T 
denote the James- Peel tree for (a, t)D gotten by replacing every James- Peel move 
Rx^y labeling an edge of T by Ra{x}-^a{y), and every move C^^y by Cr(x)^T{y), 
and relabeling vertices accordingly. Whenever a move labeling an edge e of a James- 
Peel tree just permutes rows or columns, we can eliminate that move from the tree 
at the cost of relabeling rows and columns of James-Peel moves below e, as follows. 

Definition 5.1. Given a James-Peel tree T of a diagram D, define the reduced 
James-Peel tree red(7~) of D inductively. 

• li D has no children in T, then red(T) = T. 

• If D has just one child F, and D — (a, t)F for some a,T & Soo, let 7i be 
the subtree of T below F with root F. Then red(T) — (cr, r) red(7i). 

• If D has at least two children Fi,F2, . . . ,Fp or D has one child Fi not 
equivalent to D, let 71 be the subtree of T below Fi with root Fi. Then 
red(T) is T with each Ti replaced by red(7i). 

Definition 5.2. A rooted tree is bushy if every non-leaf vertex has at least two 
children. 

Lemma 5.3. IfTis a complete James-Peel tree for D, then red(T) is a complete 
James-Peel tree for D. Furthermore, red(T) is bushy. 

Proof. Note that red(T) is still a James-Peel tree for D. As equivalent diagrams 
have isomorphic Specht modules, if T is complete then so is red(T). 

Next, for any vertex A of T, the subtree of T below A is itself a complete James- 
Peel tree for A. In particular, S^ is determined by the leaves below it. Therefore, 
if A has only a single child B in T, then S^ and S^ are isomorphic. 

Now suppose T is not bushy. The only way this can happen is if T has a vertex 
A with only one child B, but A and B are not equivalent. There is a James-Peel 
move relating A, B (or a sequence of them, but we can consider them one at a time), 
say B = Ra^bA. If one of rows a and & of A is contained in the other, then Ra^bA 
is simply A with those two rows interchanged, so rows a and b are not comparable 
under inclusion since A and B are not equivalent. There are cells (a, j'l), (6,^2) G A 
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with (a, J2), (bji) i A. By Theorem 3.1, S^ © 5^^1-^2-4 ^ s^. As S"^«-^2^ ^ 0, 
S^ is not isoiTLorphic to S . This contradicts the previous paragraph, so T must 
be bushy. D 

Lemma 5.4. The number of edges in a bushy tree with k leaves is at most 2fc — 2. 
Proof. This fohows by induction on the number of leaves. D 

Recall JP{w) is the James-Peel tree for D{w) constructed in Theorem 4.2, and 
let RJP{w) = rcd{JP{w)). In the vicinity of a vertex D{v), JP{w) looks like this: 




D{vP) 



Here the v^ = vtrgtrj^ are the transitions of v, with ji > ■ ■ ■ > jp. The rows of D{v) 
involved in row moves are r, j'l , . . . , jp , and the columns involved in column moves 
are u(s),w(ji), • ■ • ,w(jp). In the figure above, we have elongated two of the paths 
for the proofs to come. 

Lemma 5.5. Suppose v has transitions v^, . . . ,wP as above. Then D{v^) is equiv- 
alent to C'y(^s)-¥v{ji)D{v), and D{vP) is equivalent to Rr^j^D[v). 



Proof. By Lemma 4.1, 



and 



D{v^) = C^(s)^^(ji)Rr^]iD{v) 



D{vP) = i?,.^j^C„(,)_,„(j^)D(w). 

It suffices to check that column v{s) of D{v) contains column v{jp), and that row 
r contains row ji. Suppose the first of these fails, that there is {i,v{jp)) G D{v) 
with (j,w(s)) ^ D(v). Choose the maximal such i. Then vtrstri is a transition 
of V, which is impossible since i < jp. The argument for the row containment is 
analogous. D 

Thus, upon passing to RJP{w), the edges A — D{v^) and B — D{vP) are con- 
tracted. For a diagram D, write [D] for the equivalence class of diagrams contain- 
ing D. We use this notation below when we have a diagram equivalent to D but 
don't need to specify exactly what the diagram is. In the vicinity of a vertex [D(w)], 
RJP{w) has the form 

[Div)] 

C ^^ /RC RC\ ^^fl 

{D(v^)\ {D{v'^)\ ■■■ [D{vP-^)] [D{vP)] 
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Strictly speaking, we haven't shown that both moves on the edges labeled RC 
survive in RJP{w), but this won't be important. We therefore will speak of R- 
edges, C-edges, and i?C-edges of RJP{w), each non-leaf vertex having exactly one 
i?-edge and one C-edge leading to children. 

Now suppose 7" is a subtree of RJP{w) with the same root. Let R{T) be the 
union of {a, &} over all Ra^b appearing in 7", and C{T) the union of {c, d} over all 
Cc^d appearing in T- Write R{T) U w~^C{T) = {ii < ■ ■ ■ < v}, and define the 
permutation associated to this tree 



wr = fl{w{ii)---w{ir)). 



Remark 5.6. In Section 2 we noted that, for convenience, w could be replaced by 
1™ X u; to remove the necessity of sometimes replacing u by 1 x w in the Lascoux- 
Schiitzenberger tree. The definition of wj- above is then an abuse of notation, since 
we are really taking a subsequence of l™ x w. However, rows and columns 1, . . . , to 
of D{w) are empty, so are not affected at all by the James-Peel moves in RJP{w) 
or T- This means that the subsequence defining wj- occurs entirely after the mth 
position of f" x w, so we are free to shift it down by m and consider it as a 
subsequence of w. This applies also to Theorems 5.9 and 5.10 below. 



We would like to bound the number of letters of wj- in terms of the number of 
leaves of T. Such a bound depends on the sizes of R{T) and C{T), so the following 
definition is convenient to get good bounds. 



Definition 5.7. A subtree T of RJP{w) with root D{w) is colorful if each non-leaf 
vertex of T has at least the two children corresponding to its i?-edge and its C-edge. 
Thus, colorful implies bushy. 



Lemma 5.8. Say T is a subtree of RJP{w) rooted at D(w) with k leaves. Then 
k < EG{w^) < EG(w). If T is colorful, then wj- € Sm for some to < 4fc — 4. 



Proof. Up to relabeling rows and columns to account for flattening, the tree T is 
a James-Peel tree for D{wf) (not necessarily complete), so fc < EG{w-r). Theo- 
rem 1.1 implies EG{wr) < EG{w). 

Suppose T is colorful. The number of letters in wr is at most \R{T)\ + \C{T)\. 
Consider the vertex indexed by D{v) in the full tree JP(w) . Say u* — vtrstrji are 
the transitions oiv, with ji > • • • > jp. The rows of D{v) involved in row moves are 
r,ji, . . . ,jp, and the columns involved in column moves are v{s),v{ji), • ■ • ,v{jp). 
However, Rr^j^D{v) ~ D{v) and Cy(^s)^v{j )D{v) ~ D{v) by Lemma 5.5, so these 
edges are contracted in the reduced tree, so row ji and column v[jp) will not 
contribute to R{T) and G{T) respectively. Thus, if a vertex F (which is equivalent 
to some D{v)) of T has p children, the edges leading down from F contribute at 
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most p elements to each of R{T) and C{T). Summing over all vertices, 
\RiT)\ + \CiT)\<2degiD{w))+ ^ 2(deg(F) - 1) 







Fer 


= 2 


> ; deg(i^) 

LfgT J 


-2\V{T)\+2 


= 4|ii;(r)|-2(|y(r)|-i) 


^2\E{T)\ 


< 4fc - 4, 


with the last inequality by Lemma 5.4. 





o 

In particular, taking 7" = RJP^w) in Lemma 5.8 gives the following theorem. 

Theorem 5.9. Any permutation w contains a pattern v G Sm such that EG{w) = 
EG{v), for some m < A EG{w) — 4. 

More generally. Lemma 5.8 lets us show that /c-vexillarity is characterized by 
avoiding a finite set of patterns. 



Theorem 5.10. Say w is a permutation with EG{w) > k. 
pattern v G Sm such that EG{v) > k, for some m < Ak. 



Then w contains a 



Proof. By Lemma 5.8, it suffices to exhibit a colorful subtree of RJP{w) rooted at 
D{w) with A; + 1 leaves. Construct such a tree T as follows. First take T to have 
only the vertex D(w). Add the two children of D{w) corresponding to the _R-edge 
and the C-edge. Continue adding the remaining children of D{w) until T has fc + 1 
leaves or all children have been added. If all children of D{w) have been added and 
T has fewer than fc + 1 leaves, then since RJP{w) has at least fc + 1 leaves, there 
is a leaf F of T with at least two children. Now repeat this process starting with 
F in place of D{w). Iterating, eventually T will have fc + 1 leaves, and is colorful 
by construction. D 

Corollary 5.11. A permutation w is k-vexillary if and only if it avoids all non-k- 
vexillary patterns in Sm for 1 < m < Ak. 

For fc = 2, we can explicitly find all non-2-vexillary patterns in Sm for 1 < m < 8 
and eliminate those containing a smaller non-2-vexillary pattern to find a minimal 
list. 

Theorem 5.12. A permutation w is 2-vexillary if and only if it avoids all of the 
following 35 patterns. 

21543 231564 315264 5271436 26487153 54726183 64821537 

32154 241365 426153 5276143 26581437 54762183 64872153 

214365 241635 2547163 5472163 26587143 61832547 65821437 

214635 312645 4265173 25476183 51736284 61837254 65827143 

215364 314265 5173264 26481537 51763284 61873254 65872143 

This process is also feasible for fc = 3, in which case we need to look at non-3- 
vexillary patterns up through 5i2. Here we find that the bound in Corollary 5.11 
is not sharp. 
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Theorem 5.13. A permutation w is 3-vexillary if and only if it avoids a list of 91 
patterns in SqU St U Sg- For the full list of patterns, see 

http : / /■vwv . math . Washington . edu/~billey/papers/k . vex . html. 

The 3-vexillary permutations have some interesting properties. First, in Section 7 
we will show their Stanley symmetric functions are always multiplicity free. Second, 
their essential sets are relatively simple. 

In [10], Fulton defined the essential set of a permutation w, Ess{w), to be 
the set of southeast corners of the connected components of the diagram D{w). He 
showed that the rank conditions for the Schubert variety indexed by w need only be 
checked at cells in the essential set. Furthermore, he showed that the essential set of 
a vexillary permutation has no two cells (zi, ji) and {12, J2) with zi < Z2 and ji < J2- 
Thus, the essential set lies along a lattice path going from the southwest corner of 
the diagram to the northeast using only north and east steps. See ['.'^ , Prop. 4. 6] 
for an alternative description of the essential set using minimal bigrassmannian 
elements not below w in Bruhat order. 

One can characterize permutations whose essential set consists of two noninter- 
secting such lattice paths in terms of pattern avoidance. 

Lemma 5.14. A permutation w has essential set with no three cells {ii,ji), (12, J2); 
and {i3,J3) with ii < 12 < is and ji < J2 < J3 if and only if w avoids the 25 patterns 

214365 3251746 35172864 35281746 53182764 

2416375 3251764 35182746 35281764 53271846 

2417365 4216375 35182764 53172846 53271864 

3152746 4216735 35271846 53172864 53281746 

3152764 35172846 35271864 53182746 53281764 

Corollary 5.15. If a permutation w is 3-vexillary, its essential set does not contain 
any three cells {ii,ji), («2, J2), (is, js) with ii < 12 < iz and ji < J2 < is- 

Proof. None of the patterns in Lemma 5.14 are 3-vexillary, so this follows from 
Corollary 4.3. D 

Remark 5.16. The essential set can be used to give a short proof that the Lascoux- 

Schiitzenbcrger tree is finite. First, the L-S tree can contain only finitely many w 
with more than one maximal transition, e.g. because Fu, = '^^ Fy for v running over 
transitions of w, and the coefficient oi xi ■ ■ ■ xe in Fu, is always positive. Second, if 
Ess(w) lies in a single row, then w is vexillary by Fulton's result above. Otherwise, 
if w is not vexillary but has exactly one maximal transition v = wtrstrj where r is 
the largest index of a non-empty row in Ess{w), then one can show by considering 
the diagram of the permutation that Ess{v) = Ess{w) \ {(r, s)} U {(r — 1, s — 1)}. 
The same argument holds if w must be replaced by 1 x ly in the algorithm. Thus, 
either the distance between the top and bottom (non-empty) rows of the essential 
set strictly decreases upon passing from w to w, or this distance remains the same 
but the number of elements in the essential set in the bottom row decreases. 

Searching through all non-4-vexillary permutations in 5*16 is currently beyond 
our computational capabilities. However, one does find that every non-4-vexillary 
permutation in S'13 contains a proper non-4-vexillary pattern. 

Conjecture 1. A permutation w is A-vexillary if and only if it avoids a list o/2346 
patterns in 5*6 U 6*7 U • • • U 5*12 . 
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For the minimal list of non-4- vexillary patterns in S13, see 

http : / /■vw . math . Washington . edu/~billey/papers/k . vex . html. 

If one wants to compute or bound EG{w), the Lascoux-Schiitzenberger tree is 
almost certainly more efficient than using our pattern characterizations. However, 
pattern characterizations lend themselves nicely to comparison, as exemplified in 
the proof of Corollary 5.15. The connection to patterns also leads to enumerative 
results relating to EG{w), since there has been much work done on enumerating 
permutations avoiding a given set of patterns, for example [4]. 

6. Diagram varieties 

Let Gr(fc, ri) denote the Grassmannian variety of fc-planes in C". For a diagram 
D contained in a fc x (n — fc) rectangle, let i7^ be the set of /c-planes given as row 
spans of the matrices 

{{Ik\A) : A e Mkx{n-k),A,j = if (i,j) e D}. 

Here Ik is the k x k identity matrix. Let fto be the closure of n°jj in Gr(A;, n). We 
call flo the diagram variety associated to D (though it also depends on k and n). 
Recall that partitions contained in the rectangle k x {n — k) are in bijection with 
/c-subsets of [n]. Specifically, A corresponds to the set 



Bx ^ {n - k + i - X^ : 1 < i < k}. 



Write 



Bx = {bi< ■■■ < bk} and [n] \ Ba = {ci < • • • < c„_fe}, 

and define a permutation wx of [n] in one-line notation by wx = 61 • • • bkCi ■ ■ ■ Cn^k- 
Taking the standard basis ei, . . . , e„ of C", define a complete flag F, by 

Fi = (ei,...,ej). 

The Schubert cell is defined as 

Xl^{X e Gr(fc,n) : dim(X n Fi) > dim(X n Fi^i) if and only if i G Bx}, 

and its closure in the Zariski topology on Gr{k,n) is the Schubert variety Xx [ ']■ 
The codimension of Xx is |A| as defined. In particular, the diagram variety ftx 
indexed by the Ferrers diagram for A can be written as fix = Xxwx since right 
multiplication by a permutation matrix permutes columns of the matrices in Xx- 
Thus diagram varieties generalize the Schubert varieties up to change of basis. 

Let ax be the cohomology class in _ff^l^l(Gr(fc, n),Z) associated to fix- One has 
the following classical facts about the Schubert classes ax (see [11]). 

• The classes ax for A varying over all partitions contained in (fc"~'^) form a 
Z-basisof if*(Gr(/c,n),Z). 

• Let A denote the ring of symmetric functions over Z in infinitely many 
variables. Then ax f^ sx defines an isomorphism of rings 

(j) : H*{GT{k,n),Z) ^ A/{sx : A g (fc"-''^). 

The second fact suggests a relationship to Specht modules. For example, consider 
the skew shape A ■ /z obtained by placing A, /i together with no cell from A in the 
same row or column as a cell from /x: 
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Suppose A • /u is contained in (fc"~'^). The multiplicity of the irreducible S" in S^'^^ 
is the Littlewood- Richardson coefficient c\ . This is also the coefficient of Si, in the 
Schur expansion of s\.^ = s\s^, hence the coefficient of cFi, in a\.^ [ ]. 

Every closed subvariety of the Grassmannian has an associated cohomology class 
[9]. In particular, each diagram variety VLd has an associated class ao which can be 
expressed as a symmetric function via (j). Liu studied diagram varieties and their 
cohomology classes in [2U], and made the following conjecture, which generalizes 
the remarks above. 

Conjecture 2 (Liu's conjecture). Let D C (fc"^'^). // the generalized Schur func- 
tion sd associated to D expands into classical Schur functions as 

SD =^cfsA, 

A 

then the cohomology class for fljj has the same expansion coefficients 

CTD =J2'^^'^^- 

A 

Thus, the map <f> sends ud to sd. 

Remark 6.1. One can show that if D is contained in (fc"~'^), so is any A with 
S^ ^^ S^ (this is obvious when D has a complete James- Peel tree). 

Let I?^ denote the complement of D in the rectangle (fc"^*^). Conjecture 2 is 
known in several special cases. 

Theorem 6.2 ([20, Proposition 5.5.3]). Conjecture 2 holds when D^ is a skew 
shape A//i. 

Given a diagram D in [k] x [n — k], Liu constructs a bipartite graph Gd = 
([fc], £', \n — A:]) where E contains an edge (i, j) if and only if (i, j) € D. 

Theorem 6.3 (["'", Theorem 5.4.3]). Conjecture 2 holds for a diagram D provided 
Gd"^ is a forest. 

A key tool in Liu's proof of Theorem 6.3 is an analogue of Theorem 3.1, albeit 
with stronger hypotheses. Given ai,a2 G i?*(Gr(fc,n)), write ai > a2 if ai — ol2 
is a nonnegative linear combination of the Schubert classes a\ . 

Proposition 6.4 ([^U, Proposition 5.3.4]). Let D be a diagram, and («i, ji), («2, J2) 6 
D such that (Ji,J2), («2, ji) ^ D. Suppose also that if {p,ji), {p,J2) G D, then row 
p oi D contains rows ii and 12- Then 

Like the Schur function sd, ao only depends on D up to equivalence. 
Lemma 6.5. If D,D' are equivalent diagrams, then ub = (^d'- 
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Proof. Permuting columns of D corresponds to a change of basis of C", which 
does not change an since multiphcation by an element of GL„ induces a rational 
equivalence on varieties in Gr(fc,ri) [ ]. As for rows, identify a permutation v with 
a permutation matrix. If {I\A) is a matrix representing a point of flo, then (/|t;^) 
represents the same fc-plane as {v~^I\A), and so by permuting the first k basis 
vectors according to v, we see that ao is not affected by permuting rows of 13. D 

Liu proves a weaker result than Conjecture 2 in the case of diagram varieties for 
the complement of a permutation diagram. 

Proposition 6.6 ([20, Proposition 5.5.4]). Under the Pliicker embedding ri£)(^,)v ^^■ 
Gr(fc,n) -^ pi^)-\ the degree of Qoiw)^ is dim S'^^'") = |Red(w)|. 

Remark 6.7. Note that this is what the degree must be if Conjecture 2 is to hold. 
This is because (T(i) is the class of a hyperplane intersected with Gr(fc, n) in the 

Pliicker embedding, so the degree of flov is the coefficient of crj-j-n-fc-) in ctijv -aL-} [!)]. 
When 13 = A is a partition, it is easy to see using Pieri's rule that this coefficient is 
the number of standard Young tableaux of shape A, which is the dimension of S^. 
The claim for general D follows by linearity. 

Thanks to Proposition 6.6, in order to prove Conjecture 2 for i~lD(w)'-' i it is enough 
to show that 0((TD(to)v) > S£)(m)v- This follows immediately from Theorem 4.2 and 
Proposition 6.4 whenever the conditions of Proposition 6.4 are satisfied throughout 
JP{w), the James-Peel tree for D{w). 

Theorem 6.8. Conjecture 2 holds for D(w)^ whenever each James-Peel move 
in JP(w) satisfies the conditions of Proposition 6.4, or else is an equivalence of 
diagrams. 

We can give some conditions on w which guarantee that Conjecture 2 holds for 
D(w)'^ . First, suppose D is any diagram such that there are zi < ^2, ji < J2, and p 
such that («i,ji),(«2,j2),(p,ji),(p,J2) e D but (ii, J2), (»2, ji) ^ D. Suppose also 
that row p oi D does not contain one of rows 11,12, so that there is j such that 
{p,j) ^ D but {ik,j) & D for one of fc = 1, 2. We draw the possible subdiagrams of 
D in rows ii,i2,P and columns ji,j2,j, using • for the cells (ii, ji), (ji, J2) and o 
for the cells (p, ji), (p,j2), {"^kij), with * for a cell which may or may not be in D: 
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Now suppose D is northwest: that if zi < Z2, j'l < J2 and (Ji, J2), (i2, Ji) G -D, 
then (Ji,ji) G I?. This rules out all the subdiagrams above except 

o o • • • • o • • 

• • • o o • • o o . 

• o • • o • • • 

Each of these three (sub)diagranis has Schur function S221 + S311 + S32 . Moreover, 
each one has a complete James-Peel tree (e.g. because they are equivalent to per- 
mutation diagrams), so Corollary 3.19 implies that sd has at least 3 Schur function 
terms. More generally, if D labels a vertex of a James-Peel tree for some other dia- 
gram E, then se has at least 3 Schur function terms. Therefore, if Se has at most 
2 Schur function terms and E has a complete James-Peel tree, then Conjecture 2 
holds for E. In particular, permutation diagrams are always northwest. 

Theorem 6.9. If w £ Sn is 2-vexillary, then Conjecture 2 holds for _D(w)^. 

One can get somewhat better results by various tricks. For example, the home- 
omorphism Gr(A:,n) — >■ Gr(n — k,n) given by orthogonal complement sends flu 
to riEft after a change of basis, so the induced isomorphism H*{GT{n — k,n)) — > 
H*{Gr{k,n)) sends a£)t to (Td- Therefore, the coefficient of (7\ in an is the same 
as the coefficient of a\t in a^t . Since the analogous statement is true for Schur 
functions of diagrams, Conjecture 2 holds for D if and only if it does for 13*. 

On the other hand, the condition of Proposition 6.4 is not symmetric under 
transpose. That is, if D contains one of the three bad subdiagrams above, we may 
try transposing it, applying the appropriate James-Peel move with Proposition 6.4, 
and transposing back. As above, one can write down the subdiagrams which prevent 
this from going through, and find that their Schur functions all have at least 4 terms. 
This gives 

Theorem 6.10. If w £ Sn is S-vexillary, then Conjecture 2 holds for D{w)^ . 

Theorems 6.2 and 6.3 prove Conjecture 2 when D{w) is equivalent to a skew 
shape or a forest, and we note that these have nice statements in terms of pattern- 
avoidance as well. It is shown in [ ] that if w is 321-avoiding, then D{w) is equivalent 
to a skew shape. As for forests. 

Theorem 6.11. The graph Gu{w) is a forest if and only if w avoids 3412, 4312, 
3421, and 4321. 

The permutations avoiding these four patterns have been studied by Elizalde [7] 
in the context of almost increasing permutations. 

Proof. Clearly, if D{w) has the property that the graph G'£i(^,) is a forest, then so 
do all its subdiagrams. Therefore, w cannot contain 3412, 4312, 3421, or 4321, as 
one easily checks that none of these have graphs which are forests. 

For the converse, suppose that G — Gd(w) is not a forest. Take a sequence of 
distinct cells bi, . . . ,bm & D forming a cycle in G. Choose i so that hi — {p, q) with 
q maximal, then with p maximal for that q. The three cells 5i_i, bi, bi+i then form 

the pattern in D{w). Since D{w) is northwest, it therefore contains 

o o 
o o 
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o X 
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as a subdiagram. After adding x to these rows and columns as usual for a permu- 
tation diagram, we must end up with one of the four following subdiagrams: 

o o X • 

o o • X 

X • • • 
X 

Then in the positions of w corresponding to these four rows one finds a pattern 
3412, 4312, 3421, or 4321. D 

7. Multiplicity Bounded Permutations 

We will say a permutation w is multiplicity free provided all nonzero coefficients 
of the Stanley symmetric function F^, are 1. See A224287 in the OEIS for the num- 
ber of multiplicity free permutations in Sn as a function of n. By Corollary 4.4, we 
know the multiplicity free permutations respect pattern containment in the classi- 
cal sense. We discuss a new type of pattern containment which these permutations 
also respect using the code of a permutation. We follow up with another variation 
on the theme of bounding the multiplicities in a Stanley symmetric function which 
generalize vexillary permutations. 

Lemma 7.1. Every 3-vexillary permutation is multiplicity free. 

Proof. Apply Lemma 3.11 to D{w). D 

The following conjecture has been tested through 5i2 and one direction follows 
from Corollary 4.4. For the minimal list of 189 patterns up to Sn, see 

http : //www . math . Washington . edu/~billey/papers/k . vex . html. 

Conjecture 3. The set of multiplicity free permutations is closed under taking 
patterns and the minimal patterns all occur in Sn for n < 11. 

Recall the inversion set of w e S'„ is 

Inv(w) — {(«, j) ■ 1 <i < j <n and Wi > Wj}. 

The code of w is the vector code(w) — (ci, . . . ,c„) such that Ck is the number of 
inversions {k,j) for any k < j < n. Equivalently, Ck is the number of cells on 
row k of D{w). An inverse operation code^ (ci, . . . , c„) is obtained by multiplying 
out the reduced expression {s^ • . . S2S1) • (sc2+i • • ■ S3S2) ■ • • {sc„+n-i ■ • • Sn) where 
each factor is a consecutive decreasing string of adjacent transpositions. Adding 
additional zeros at the beginning or the end of the code will not change the corre- 
sponding Stanley symmetric function. Furthermore, for every vector of nonnegative 
integers there exists a permutation with this vector as its code plus possibly some 
additional terminal O's. 

For example, code" (3,0,5,1) = (S3S2S1) • (S7S6S5S4S3) ■ (54) = 41832567 and 
code(41832567) = (3, 0, 5, 1, 0, 0, 0, 0). 

Definition 7.2. We will say a permutation w contains a permutation w as a simple 
code pattern provided code(w) = (ci, . . . , c„), there exists an i such that c; = 0, and 
code" (ci, . . . , Ci, . . . , c„) = V. Say w contains w as a code pattern provided there 
exists a sequence of permutations u^^\ . . . , u^*^^ such that w = u^^\ v = u'^''^ and 
each m'^*) contains u(*+^) as a simple code pattern. In this case, |£'(w)| — \D{w)\. 



28 SARA BILLEY AND BRENDAN PAWLOWSKI 

Lemma 7.3. Ifw contains v as a code pattern, then S''^*-^^ ^->- S-^'-^' as a submodule 
and Fw — Fy is Schur positive. 

Proof. Without loss of generality, assume that w ^ Sn contains w G S'„ as a simple 
code pattern, and the code of v is obtained from the code of w by removing Cfc = 
and adding a zero at the end. Since Ck = 0, w{k) — min{u'(fc), w{k + 1), . . . , w{n)}. 
Let D be D{'w) with the empty row k removed, so S^ ~ gD(w} ^ 

Recall that the code of a permutation is given by the number of elements in the 
diagram on each row. Going from a code vector to the corresponding diagram is 
easy. Starting at the first row, fill in the appropriate number of cells left justified. 
Place an x in the next position and cross out everything below and to its right. 
For the next row, starting from the leftmost available position that hasn't already 
been crossed out, greedily place the appropriate number of cells moving left to right. 
Once the cells are placed in the row, put an x in the next available position and 
cross out everything below and to the right of the x . Continue until only fixed 
points are added to the permutation. Thus, the first fc — 1 rows and w(k) — 1 
columns of D and D{v) are identical since the codes of v, w agree in the first k — 1 
positions. 

It remains to show that there exists a sequence of James-Peel moves taking D 
to D{v) which only modifies cells southeast of (fc, w(fc)). Let ji < J2 < ■ ■ ■ < ja be 
the occupied columns of D{w) southeast of (fc, w{k)). Let jo — wik). Observe that 
D{'w) is empty in column jo below row fc but may contain cells above row fc. We 
claim that for i > k and 1 < / < a, {i,ji) G D{w) if and only if (i,ji_i) G D{v) by 
construction of the diagram from the code. So we can shift the occupied columns 
of D{w) southeast of (fc, w{k)) over left by applying Cj^^j-^ to D and then applying 
Cj-^^j^^ etc. Furthermore, for i < fc if {i,ji) G D then (i,j;_i) G D and D and D(v) 
agree above row fc, so applying each Cji^ji_-^D does not change any cells above row 
fc. Thus, 

We conclude that S'^(^) ^ S^^"^^ by Lemma 3.13. D 

Corollary 7.4. Assume w contains v as a code pattern. If w is multiplicity free, 
then so is v. 

Next we generalize multiplicity free permutations to a filtration of permutations. 

Definition 7.5. A permutation w is k- multiplicity bounded provided each a^x < k 
in the expansion F^ — ^^a^xsx. Thus, 1-niultiplicity bounded is the same as 
multiplicity free. 

For each fc > 1, the set of all fc- multiplicity bounded permutations respects 
pattern containment by Corollary 4.4. If one could bound the size of the minimal 
patterns which are not fc-multiplicity bounded, then one would prove the following 
conjecture. 

Conjecture 4. The k-multiplicity-bounded permutations are defined by avoiding a 
finite set of permutation patterns. 

8. Future work 

We were led to Theorem 1.1 by trying to study pattern containment for diagrams. 
In particular, we observed in experiments that the conclusion of Corollary 3.19 
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holds for arbitrary diagrams and subdiagrams. Is this always true? Corollary 3.19 
holds when the subdiagram is (equivalent to) a permutation diagram, a skew shape, 
or a column-convex diagram, since these diagrams all admit complete James-Peel 
trees. The algorithm given by Reiner and Shimozono in [ ] for decomposing Specht 
modules shows that the conclusion of Corollary 3.19 also holds when D is percent- 
avoiding and D' = D r\{i : a <i <b} X {j : c < i < d) ioT some a, b, c, d. 

We have no simpler characterizations of the lists of patterns arising from Corol- 
lary 5.11 and Theorems 5.12 and 5.13. One necessary condition for w to be non- 
/c-vexillary but contain only fc-vexillary patterns is that every 'w{i) participates in 
some 2143 pattern. Otherwise, the ith row and w{i)i\i column of D[w) are con- 
tained in or contain every other row and column, and so they do not participate 
in the James-Peel moves of RJP{w). This is far from sufficient, however. Mag- 
nusson and Ulfarsson [:'2] have developed an algorithm for characterizing sets of 
permutations in terms of avoiding mesh patterns, but this algorithm does not seem 
to simplify our patterns appreciably. One might try even more general notions 
of patterns, such as marked mesh patterns. Bridget Tenner has noted that some 
2-vexillary patterns do collapse. In these cases though, the algorithms for detecting 
pattern containment require checking for the original patterns. 

In [■>], vexillary elements of types B,C,D in the hyperoctahedral group are 
defined as those whose Stanley symmetric function is equal to a single Schur P- or 
Q- function (P in types B, D, and Q in type C), and it is shown that the vexillary 
elements are again characterized by avoiding a finite set of patterns. Computer 
calculations show that Corollary 4.3 with k = 2 holds in Bg for types B, C and 
in Ds] moreover, the 2-vexillary patterns in Bg of types B, C are characterized by 
avoiding sets of patterns in i?3 U • ■ • U i^s . The main obstacle to extending our 
proofs to these other root systems is the apparent lack of an analogue of the Specht 
module of a diagram. In a recent preprint [ ], Fulton and Anderson give a different 
variation on vexillary permutations in types B, C, D, and one might ask if there is 
a reasonable notion of /c-vexillary in their setting. 

Klein, Lewis and Morales have recently defined another generalization of vexillary 
permutations. For w G Sn, let D(w) be its permutation diagram. It is shown in 
[13], that the rows and columns of D{w) can be rearranged to form the complement 
of a skew shape if and only if w avoids 9 patterns. They call these skew vexillary 
permutation. Under what conditions can the rows and columns of an arbitrary 
diagram be rearranged into a skew shape or the complement of a skew shape? 
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